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(54) Virtual path shaping 

(57) Apparatus and method for sliaping ATM cell 
traffic emitted onto a virtual path connection in an ATlVl 
network are described. Component virtual channel con- 
nections are arbitrated at an aggregation point utilizing 



an arbitration technique. The technique provides both 
virtual path shaping and controllability of underlying vir- 
tual channel connections with an improved fairness per- 
formance amongst all the aggregating virtual channel 
connections. 
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Description 

Field of the Invention 

[0001] This invention relates to data communications 
networks utilizing ATM technology and more panicularly 
to apparatus and methods for scheduling/shaping multi- 
service category cell traffic onto virtual path connections 
while providing fair share arbitration between aggregat- 
ing virtual channel connections 

Background of the Invention 

[0002] Asynchronous transfer mode (ATM) technolo- 
gy is rapidly being recognized as the technology o< 
choice for broadband data communications. ATM cells 
having a fixed number of bytes can efficiently accom- 
modate multimedia traffic such as videO: voice and data. 
[0003] ATM cell traffic between nodes in an ATM net- 
work is carried on what are known as virtual connections 
(VC). Traffic from end user to end user through a plural- 
ity of intermediate nodes is carried on virtual channel 
connections (VCC) A VCC on a particular link is unique- 
ly identified by the combination of virtual path identifier 
(VPI) and virtual channel identifier (VCI) fields in the 
ATM cell headers. Since traffic from several sources 
may have a common destination it is known to combine 
virtual channel connections onto a virtual path connec- 
tion (VPC) in order to simplify the processing of traffic 
through the network. A VPC on a particular link is 
uniquely identified by the VPI field in the ATM cell head- 
er When virtual cfiannel connections are aggregated 
onto a virtual path connection the individual virtual 
channel connections are essentially transparent to the 
intermediate ATM nodes and this allows a simpler net- 
working model and higher manageability. 
[0004] A virtual path connection is defined as a logical 
grouping of multiple virtual channel connections into one 
virtual connection. An implicit logical aggregation of 
VCCs into a VPC is said to have occurred when the out- 
going VCCs all acquire the same common VPI value. 
Typically, such aggregation occurs at the egress port of 
an ATM switch where multiple VCCs from multiple in- 
gress ports converge. These aggregating VCCs might 
have different VPI and VCI values as determined at call 
setup or network planning time. The egress port of the 
ATM switch is typically equipped with a cell header 
translation function. Such a function is capable of trans- 
lating the incoming VPI and VCI values into a new set 
of VPI and VCI values. It is this function that accomplish- 
es the aforementioned implicit logical aggregation. 
When the various VPI and VCI values on the various 
aggregating VCCs all translate into a common VPI val- 
ue, a virtual path connection is formed. Note that the 
VCI value is carried transparently end-to end within a 
VPC. It is. therefore, important for the translation func- 
tion to translate the incoming VCI values into a mutually 
exclusive set of VCI values. Such mutual exclusivity al- 



lows each underlying VCC to be uniquely identified at 
the terminating end of the VPC. At that point, the VPC 
is segmented by simply switching and processing each 
underlying VCC as an individual connection The com- 
5 bination of an egress aggregation function together with 
the ingress segregation function on a bi-directional port 
is referred to as the virtual path termination point (VP- 
TP). 

[0005] Although the aggregation of virtual channel 

'0 connections onto a common path simplifies traffic man- 
agement, concerns have been expressed that individual 
virtual channel connections may not all be treated fairly 
when aggregated onto a virtual path connection 
Demirtjisand Petr(IEEE IC3N. 1995 'How to Encourage 

'S Cheating with Virtual Path Policing in ATM Networks") 
have found that virtual channel connections which are 
in compliance with predefined transmission parameters 
may be adversely affected by non-compliant traffic when 
aggregated onto a virtual path. 

20 [0006] US Patent 5.629.928 which issued May 13. 
1 997 to Calvlgnac et al discloses one technique for con- 
trolling traffic flow in a virtual path communication" sys- 
tem wherein queues allocated as needed from a pool of 
free queues are used to store all incoming data cells 

2S having the same virtual channel identifier 

Summary of the Invention 

[0007] The present invention seeks to provide shap- 
30 ing of virtual path traffic through an ATM network utilizing 
an arbitration technique. 

[0008] Therefore, in accordance with a first aspect of 
the present invention there is provided a device for 
scheduling virtual channel connections carrying cell traf- 
•35 fic of different categories of service onto a virtual path 
connection comprising: aggregating means for aggre- 
gating virtual channel connections of similar categories 
of service into a single cell stream 
[0009] In accordance with a second aspect of the 
40 present invention there is provided, in an ATM data com- 
munications network utilizing, virtual channel connec- 
tions wherein the virtual channel connections are aggre- 
gated at an aggregation point onto virtual path connec- 
tions, an apparatus for shaping ATM cell traffic com- 
-'5 prised of various categories of service onto the virtual 
path connection, the apparatus comprising: queuing 
means for queuing cells from each of the virtual channel 
connections: arbitration means to arbitrate between the 
virtual channel connection traffic: and a virtual path con- 
so nection shaper to determine egress emission time of 
cells from the arbitration means onto the virtual path 
connection. 

[0010] In a preferred embodiment of this aspect of the 
invention virtual channel connections carrying the vari 
55 ous categories of service, as defined by the ATM Forur 
are queued separately. Like-service-category vir^ 
channel connection queues are grouped into pe 
groups. An arbitration scheme arbitrates within 
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per-VC group and another arbitration scheme arbitrates 
between per-VC groups with like categories of service 
[0011] In accordance with a further aspect of the 
present invention there is provided in an ATM data com- 
munications network having virtual channel connections 
channel aggregated at an aggregation point onto virtual 
path connections, a method for fairly shaping ATM cell 
traffic comprised of various categories of service and 
quality of service parameters onto the virtual path con- 
nection, the method comprising the steps of; queuing 
the virtual channel connection cell traffic in separate 
queuing buffers: arbitrating between the separate queu- 
ing buffers utilizing an arbitration means: and shaping 
the arbitrated cell traffic with a virtual path connection 
shaper in order to fairly emit the cell traffic onto the vir- 
tual path connection. 

[001 2] I n a preferred embodiment of this aspect of the 
invention the shaper determines the cell egress times 
in accordance with certain traffic descriptors 

Brief Description of the Drawings 

[0013] The invention will now be described in greater 
detail with reference to the attached drawings wherein: 

Figure 1 is one prior art method of forming a virtual 
path connection at an aggregation point; 

Figure 2 represents a second prior art method of 
forming a virtual path connection at an aggregation 
point: 

Figure 3 is a block diagram of an ATM network with 
VPC aggregation: 

Figure 4 illustrates the virtual path shaping tech- 
nique of the present invention. 

Figure 5 is a functional block diagram of the vertical 
path shaping process; 

Figure 6 is a flow diagram ot the process depicted 
in Figure 5. 

Figure 7 illustrates one real time virtual path aggre- 
gation scheme: and 

Figure 8 illustrates an alternate aggregation 
scheme. 

Detailed Description of the Invention 

[0014] Known virtual path connection (VPC) aggrega- 
tion is typically performed at the egress direction of an 
ATM switch Such VPC aggregation points do not usu- 
ally have VP level shaping capability and, therefore, the 
aggregated cell stream cannot be policed in down- 
stream nodes. Other VPC aggregation points may have 



per-VC shaping capability therefore the VP must first 
be aggregated before it is shaped. This method does 
not allow controllability of the underlying VCCs at the 
VP aggregation point These controllable elements in- 

s elude such items as per-VC buffer management, rate- 
control and fairness amongst aggregating VCCs. 
[0015] Figure 1 illustrates a logical aggregation at a 
VPC aggregation point. As shown, the component 
VCCs are multiplexed onto the virtual path connection 

'0 without any virtual path shaping. This results in an un- 
controlled output cell stream which is unlikely to provide 
fair sharing of the virtual channel connection cells With- 
out shaping, the aggregated VPC traffic is likely to in- 
clude irregular flow. 

'5 [0016] Figure 2 illustrates a VPC aggregation point 
with shaping after aggregation. As in Figure 1 the com- 
ponent VCCs are aggregated at the input to the VPC. A 
single aggregate queue stores the incoming component 
VCCs prior to the per-VC shaper which shapes traffic 

20 on the VPC. There is. however, no attempt to provide 
quality-of-service differentiating arbitration between the 
component VCC traffic. 

[001 7] The technique contemplated by the present In- 
vention provides VP aggregation shaping while main- 
25 taining per-VCC isolation amongst the aggregating 
VCCs. Such isolation makes it possible to maintain per- 
VC congestion control and' quality of sen/ice differenti- 
ation on each individual component VCC For the pur- 
pose of this description the terms "component" and "ag- 
30 gregating" are used interchangeably They both denote 
the underlying VCCs which constitute a VPC. A network 
block diagram is shown in Figure 3. 
[0018] The ATM Forum has defined five service cat- 
egories relating to ATM cell traffic. The five service cat- 
35 egories are: constant bit rate (CBR). real time variable 
bit rate (rt-VBR). non-real time variable bit rate (nrt- 
VBR), available bit rate (ABR) and unspecified bit rate 
(UBR). These categories can be divided into two main 
groups: real time (CBR and rt-vbr) and non-real time 
-fo (nrt-VBR, ABR and UBR). For the real time service cat- 
egories cell transfer delay (CTD) and cell delay variation 
(CDV) are both important quality of sen/ice (C5oS) pa- 
rameters. In light of these considerations the present in- 
vention relates to a hierarchical approach in which indi- 
45 vidual VCCs are logically grouped together with com- 
mon service requirements. The technique for virtual 
path shaping according to the present invention is illus- 
trated In Figure 4. 

[0019] As shown in Figure 4. each component VCC 
so is individually queued in its respective per-VCC queue. 
As such any buffer management or congestion control 
technique can be applied to the isolated VCCs. This fea- 
ture inherently allows better fairness as each connec- 
tion's behaviour is isolated from one another In view of 
55 the aforementioned definition of multiple service cate- 
gories wherein each requires a different quality of serv- 
ice, the present invention addresses the relevant issue 
by introducing multiple arbitration hierarchies. The low- 



EP 0 901 307 A2 



est level depicted in Figure 4 is the service group level. 
All component VCCs within the same service group ef- 
fectively share the same level of service as one unique 
arbitration technique is applied to all members of a par- 
ticular service group The arbitration can be for exam- 
ple, a simple round-robin technique, an exhaustive 
round-robin technique a weighted round-robin tech- 
nique a weighted fair queuing technique or any other 
scheduling technique The arbitration choice is depend- 
ent on the performance and implementation complexity 
desired For the best fairness performance a per-VC 
weighted fair queuing is used This technique however 
incurs the highest level of implementation complexity. 
[0020] After the VCCs have been arbitrated as be- 
tween service groups the next hierarchical level is to ar- 
bitrate amongst all the service groups. As a potential ap- 
plication of this technique it is possible to map the five 
service categories defined by the ATM Forum into five 
separate service groups. Otherwise, it is possible to 
map the real time service categories into one group and 
the non-real time service categories into the other The 
usage and partition of the service groups are considered 
to be implementation decisions. Depending on the de- 
sired level of complexity versus performance, it is pos- 
sible to choose from the various arbitration techniques 
discussed previously. For instance, if the service groups 
are mapped into real time and non-real time service cat- 
egories, the inter-group arbitration can be as simple as 
exhaustive servicing with the real time group having ab- 
solute priority over the non-real time group. This gives 
the real time group's connections better delay perform- 
ance 

[0021] The two levels of arbitration determines the 
next cell which is to be transmitted and the shaper de- 
termines in the time domain when that cell can be emit- 
ted for the virtual path connection given certain traffic 
descriptors. These descriptors might include peak cell 
rate (PGR), sustained cell rate (SCR), and maximum 
burst size (MBS). Upon the determination that a cell can 
be emitted the inter-group's arbiter determines which 
service group is allowed to send and the chosen service 
group arbiter then further determines which component 
VCC should be served Once the VCC is determined the 
cell at the head of that per-VCC queue is extracted and 
transmitted. 

[0022] With this VP aggregation technique it is possi- 
ble to achieve both VP shaping and controllability of un- 
derlying VCCs with an improved fairness performance 
amongst all the aggregating VCCs. 
[0023] Figures 5 and 6 provide, respectively, a func- 
tion diagram and a flow diagram of the shaping process. 
[0024] Figure 5 sets out the following functional steps: 

1) cell arrival event: 

2) arrival notice: 

3) discard decision based on current congestion 
condition: 

4) queue manager determines the physical enqueu- 



ing location: 

5) VPC shaper scheduling cell emission in time do- 
main: 

6) VCC arbitration block signals the chosen compo- 
5 nent VCC given a certain arbitration scheme: 

7) queue manager dequeues the cell from the cho- 
sen component VCC: and 

8) cell transmission 

10 [002S] Figure 6 shows the steps in flow diagram for- 
. mat. 

[0026] The system according to the present invention 
supports aggregation for all of the aforementioned serv- 
ice categories. An end-to-end VPC connection orlgi- 

'5 nates at an egress port (near-end node) and ends at an 
Ingress port (far-end node). These ports or points are 
denoted VP Termination Points (VPTPs). Accordingly a 
VPC aggregates at egress and segregates at ingress 
The system support for VPCs pertains to its ability to 

20 shape and arbitrate amongst the aggregating connec- 
tions. A description of an architectural model for arbi- 
trating real-time service categories follows. 
[0027] For real-time VPC aggregation in egress, the 
system supports aggregation of all five of the previously 

25 identified service categories. Figures 7 and 8 graphically 
Illustrates two options for the handling of priorities within 
the aggregating VPTP. 

[0028] The first option is shown in Figure 7 As shown 
Universal Card Slots (UCSs) 30 are connected via 

30 VCCs 32 through the switching fabric 34 to the arbitra- 
tion/shaper device 36 of this embodiment. Device 36 In- 
cludes per-VC queues 38 (CBR/rt-VBR). 40 (nrt-VBR). 
42 (ABR) and 44 (UBR). Around-robin (RR) arbitration 
scheme 46 Is implemented within each VC group. Hier- 

■35 archical arbitration as between service categories is im- 
plemented by Exhaustive Round Robin scheme 48 and 
Weighted Round Robin scheme 50 as will be discussed 
later Temporal shaper 52 determines egress times of 
cells from respective queues to VPC 54 

40 [0029] In the egress direction, aggregating VCs are 
per-VC queued. CBR and rt-VBR categories of service 
are serviced exhaustively over all other service catego- 
ries. These CBR and rt-VBR connections are serviced 
in a round-robin (RR) fashion amongst themselves. For 

■iS non-real time (nrt) VBR. ABR and UBR connections, 
they are sen/iced in a weighted-round-robin (WRR) 
fashion. As in the real lime case like-service-categories 
connections are serviced in a simple round-robin fash- 
ion. 

so [0030] The reason for separating nrt-VBR. ABR and 
UBR with WRR is as follows: nrt-VBR is separated out 
so that sustainable cell rate (SCRO) and peak cell rate 
(PCRO and PCR1 ) type shaping would not take up all 
the bandwidth if users choose to send cell loss priority 

ss (CLP1 ) cells. ABR and UBR are separated to have their 
own weight so that a simple explicit rate (ER) algorithm 
can be used and still achieve available bandwidth par- 
titioning between ABR and UBR in both port and VPTP 
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levels 

[0031] Given that usage of CLP 1 traffic in VBR service 
category can be ignored taking into account usage of 
the ER algorithm, a simpler scheme for VPC aggrega- 
tion can be implemented as shown in Figure 8. As 
shown in Figure 8 there are three groups of per-VC 
queues CBR and rt-VBR 60 nrt-VBR 62. and ABR/UBR 
64. These three groups are serviced in an exhaustive- 
round-robin fashion (66) Within each group, they are 
serviced with a simple found-robin (RR) scheme The 
nrt-VBR traffic is isolated such that UBR traffic cannot 
overwhelm nrt-VBR connections. 
[0032] The outgoing shaping priority and characteris- 
tics are associated with the outgoing VPC's service cat- 
egory With the per-vC queuing nature maintained, the 
buffer management strategy operates similarly with re- 
spect to other connection types (i.e. simple VCC. VPC 
switching connections) Discard algorithms such as early 
packet discard (EPD) work on a per-VC basis for these 
aggregating VCCs. 

[0033] For non-real-time VPCs, all underlying traffic 
must be non-real-time. Therefore, there is no exhaus- 
tive-round-robin arbitration between the real-time group 
and the non-real-lime group. The WRR scheme still ap- 
plies to the aggregating non-real time VCC in the option 
of Figure 7. For the option of Figure 8 the CBf=l/rt-VBR 
group is simply removed from the inter-group contention 
and the ERR scheme is replaced with WRR. 
[0034] While particular embodiments of the invention 
have been disclosed and illustrated, it will be apparent 
to one skilled in the art that variations and alternatives 
can be implemented without departing from the basic 
concept of the invention. It is to be understood that such 
variations and alternatives, to the extent possible, fall 
within the scope of the invention as defined by the ap- 
pended claims. 



Claims 

1 . A device for scheduling virtual channel connections 
carrying cell traffic of different categories of service 
onto a virtual path connection comprising: 

aggregating means for aggregating virtual 
channel connections of similar categories of 
service into a single cell stream. 

2. A device as defined in claim 1 wherein virtual chan- 
nel connections carrying different categories of 
service are queued in separate queues. 

3. A device as defined in claim 2 wherein said aggre- 
gating means includes means to form groups of 
said separate queues 

4. A device as defined in claim 3 wherein said aggre- 
gating means includes arbitration means. 



5. A device as defined in claim 4 wherein said aggre- 
gation means includes means to form per-VCC like- 
service-category queues and said arbitration 
means arbitrates priority as between said like-cat- 

5 egory-queues 

6. A device as defined in claim 5 wherein said arbitra- 
tion means includes means to arbitrate priority as 
between said separate queues within said groups 

)0 of queues. 

7. A device as defined in claim 1 including multilevel 
arbitration means to arbitrate between virtual chan- 
nel connections in an hierarchical manner 

TS 

8. A device as defined in claim 6 including shaper 
means to determine egress time of cells in said sin- 
gle cell stream 

20 9. A device as defined in claim 8 wherein said egress 
time is shaped in accordance with traffic descriptors 
specified for said virtual path connection. 

10. A device for shaping virtual channel connections 
25 carrying cell traffic of different categories of sen/ice 

onto a virtual path connection comprising; queuing 
means for queuing cells of like-service-categories; 
arbitration means for arbitrating between said 
queues; and shaper means for shaping said cells 
30 into a single cell stream on said virtual path connec- 
tion. 

11. In an ATM data communications network utilizing 
virtual channel connections wherein said virtual 

3S channel connections are aggregated at an aggre- 
gation point onto virtual path connections, an appa- 
ratus for shaping ATtvl cell traffic comprised of var- 
ious categories of service onto said virtual path con- 
nection, said apparatus comprising; 

40 

queuing means for queuing cells from each of 
said virtual channel connections: 
arbitration means to arbitrate between said vir- 
tual channel connection traffic; and 
4S a virtual path connection shaper to determine 

egress emission time of cells from said arbitra- 
tion means onto said virtual path connection 

12. An apparatus as defined in claim 11 wherein said 
50 virtual channel connections carry different catego- 
ries of service cell traffic 

13. An apparatus as defined in claim 12 wherein said 
queuing means queues said virtual channel con- 

55 nections according to said category of service 

14. An apparatus as defined in claim 13 wherein said 
HfbiifHtion means arbitrates priority as between 
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10 



said virtual channel connections. 

15. An apparatus as defined in claim 14 further includ- 
ing second arbitration means to arbitrate priority as 
between categories of service ^ 

16. An apparatus as defined in claim 15 wherein said 
categories of service comprise real time and non- 
real time service classes 

10 

17. An apparatus as defined In claim 16 wherein said 
real, time class of service include constant bit rate 
(CBR) and real time variable bit rate(rtVBR) traffic 



18. An apparatus as defined in claim 16 wherein said 
non-real time class of sen/ice Includes non-real time 
variable bit rate (nrtVBR). available bit rate (ABR) 
and unspecified bit rate (UBR). 

19. An apparatus as defined in claim 11 wherein said 
shaper determines egress time of cells in accord- 
ance with traffic descriptors. 

20. An apparatus as defined in claim 1 9 wherein said 
traffic descnptors include peak cell rate (PGR), sus- 
tained cell rale (SCR) and maximum burst size 
(MBS). 

21. An apparatus as defined in claim 15 wherein said 
second arbitration means utilizes an exhaustive 
round-robin arbitration scheme. 



connections (VCC) onto a virtual path connection 
(VPC) wherein said virtual channel connections 
carry ATM cell traffic of different categories of serv- 
ice, said device comprising: queuing means for 
forming per-VCC queues containing similar catego- 
ry of service cells; first arbitration means within each 
per-VCC queue for arbitrating priority between sim- 
ilar category of service cells: a second arbitration 
means for arbitrating priority between said per-VCC 
queues: and shaper means for determining egress 
time of said cells from said second arbitration 
means onto said virtual path connection 

26. A device as defined in claim 25 wherein a third ar- 
'5 bitration means arbitrates between some of said 

per-VCC queues with the results of said third arbi- 
tration means being arbitrated by said second arbi- 
tration means together with the other per-VCC 
queues. 

20 

27. A device as defined in claim 26 wherein said first 
arbitration means is a round robin scheme 

28. A device as defined in claim 26 wfierein said second 
25 arbitration means is an exhaustive round robin 

scheme. 

29. A device as defined in claim 26 wherein said third 
arbitration means is a weighted round robin 

30 scheme. 



22. An apparatus as defined in claim 15 wherein said 
second arbitration means utilizes a weighted round- 
robin arbitration scheme. 



23. An apparatus as defined in claim 1 5 wherein said 
second arbitration means utilizes a weighted fair 
queuing arbitration scheme. 

40 

24. In an ATM data communications network having vir- 
tual channel connections channel aggregated at an 
aggregation point onto virtual path connections, a 
method for fairly shaping ATM cell traffic comprised 

of various categories of service and quality of serv- ■'5 
ice parameters onto said virtual path connection, 
said method comprising the steps of: 



queuing said virtual channel connection cell 
traffic in separate queuing buffers: ^' 
arbitrating between said separate queuing buff- 
ers utilizing an arbitration means: and 
shaping said arbitrated cell traffic with a virtual 
path connection shaper in order to fairly emit 
said cell traffic onto said virtual path connec- s 
tion. 

25. A device for arbitrating and shaping virtual channel 
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(54) Virtual path shaping 

(57) Apparatus and method for sfiaping ATM cell 
traffic emitted onto a virtual path connection in an ATM 
network are described. Component virtual channel con- 
nections are arbitrated at an aggregation point utilizing 



an arbitration technique. The technique provides both 
virtual path shaping and controllability o^underlying vir- 
tual channel connections with an improved fairness per- 
formance amongst all the aggregating virtual channel 
connections. 
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